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Abstract 

We review the notion of perfect recall in the literature on interpreted 
systems, game theory, and epistemic logic. In the context of Epistemic 
Temporal Logic (ETL), we give a (to our knowledge) novel frame condition 
for perfect recall, which is local and can straightforwardly be translated to 
a defining formula in a language that only has next-step temporal operators. 
This frame condition also gives rise to a complete axiomatization for S5 
ETL frames with perfect recall. We then consider how to extend and 
consolidate the notion of perfect recall in sub-S5 settings, where the various 
notions discussed are no longer equivalent. 

1 Introduction 

Perfect recall is an epistemic-temporal notion concerning an agent's ability to 
remember the past. It does not entail that all knowledge an agent currently has 
is preserved — in fact, certain (negative) knowledge must be lost as the agent 
learns. For example "I know that I don't know p" is lost when I learn p. Rather, 
it means that an agent remembers all the information he once had, and can use 
it to reason about the present. 

The notion of perfect recall is well-studied in game theory (see, e.g., fH] 
and [lOl Section 11.1.3]) and in the distributed computing/interpreted sys- 
tems/temporal logic literature [H HU [2Ql [13] (see [6] for a discussion from the 
viewpoint of the intersection of both) . In recent years, it has also been discussed 
in the epistemic logic community [ITU H71 IT51 [Hj , specifically in the context of 
Epistemic Temporal Logic (ETL) (see, e.g., [IT]). ETL is an epistemic logic (or 
rather, family of logics) with added event modalities, interpreted on tree models, 
and it is intended to capture interactions of agents over time. Unlike with inter- 
preted systems, the motivation is not dominated by the idea of processes with 
control programs which govern their behavior into infinity, and therefore, ETL 
does not necessarily aim at making statements about such long-term behavior. 
Although the concept of histories (corresponding to runs in interpreted systems) 



does exist and variants of ETL with long-range operators such as "until" have 
been studied, common ETL languages focus on the local perspective and lack 
global temporal operators that can talk about indefinite time spans. In the 
following, we use "ETL" in the narrow sense of epistemic temporal logic with 
only next-step (local) temporal modalities. 

Due to the differences between the mentioned frameworks, various definitions 
and conditions for perfect recall exist. Our aim here is to review and examine 
the relevant ones from the viewpoint of a logic without long-range temporal 
operators. We use the history-based framework and notation of ETL (also used 
by Parikh and Ramanujam [13]), but interpreted systems are for our purposes 
essentially equivalent [TT] and so our considerations should be transferable, 
mutatis mutandis. 

In synchronous settings (i.e., where agents have access to a global clock), 
there is a well-known characterization of perfect recall, including a simple frame 
condition and a definition that can be expressed in ETL. In contrast, without 
synchronicity the existing characterizations of perfect recall seem to be inherently 
global in the sense that they talk about whole (prefixes of) histories (or runs), 
or refer to some arbitrary point in them. This precludes a direct translation into 
a first-order frame condition (since reachability is not definable in first-order 
logic) and also makes it unclear whether the notion can be expressed in ETL. 
This is not an issue for the interpreted systems community, since they by default 
have long-range temporal operators available^] Indeed, van der Meyden [IT?] 
axiomatized perfect recall using the "until" operator. However, this does not 
transfer to logics which only have next-step temporal operators. 



After briefly introducing ETL in Section "2| and discussing perfect recall 



from the perspective of ETL in |Scction "3 we therefore in |Section 4| propose 



an alternative characterization of perfect recall which only uses single steps of 
temporal (and epistemic) succession. We show that it is first-order definable 
and definable in ETL, and we give a complete axiomatization for S5 ETL with 
perfect recall. We then explore sub-S5 settings in |Section 5| |Scction 6| concludes. 



2 Epistemic-temporal logic (ETL) 

We focus on the single-agent case since perfect recall is a property inherent to 
one agent; all our considerations carry over to the multi-agent case. We consider 
models over some finite set E of events. A history h € E* is a finite sequence of 
events, and we denote the empty history by e. We denote sequences simply by 
listing their elements, possibly preceded by a prefix sequence. For two histories 
h, h' we write h h! if h' = he, that is, if h' extends h by one event e. We 
write h — * h' if h ~-» e h! for some event e. We denote the transitive and reflexive 
closure of — > by W, so h h' says that h is a prefix of h! (possibly h! itself), 
or vice versa, h! is an extension of h. For h h' , we sometimes also write 

1 It is not an issue for the game theory community because they do not commonly concern 
themselves with formal languages. 
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h X hi ', and h -< h! for h ^ /i' with h ^ h' . A protocol H C is a finite 
set of histories closed under taking prefixes, intuitively representing the allowed 
evolutions of the system. 

An (epistemic) accessibility relation is a binary relation ~ C H x H 
on histories. It specifies, for any given history h, the histories that the agent 
considers possible at h. Various conditions can be imposed on ~, making it 
capture various notions of knowledge or belief (for details see, e.g., Most 
commonly, the relation is assumed to be an equivalence relation, making it 
capture a notion of "correct knowledge". This case is also referred to as S5. We 
refer to less restrictive cases as sub-S5. Relevant properties include transitiv- 
ity, reflecting positive introspection, and Euclideanness, reflecting negative 
introspection. Another property is that of synchronicity, which intuitively 
means that the agent has access to a clock. It holds if, whenever h ~ h! , then 
the lengths of h and h! are equal. 

An ETL frame is a tuple T = (E, H, ~) consisting of a set of events E, a 
protocol H and an epistemic accessibility relation ~. We will usually omit E 
and H for the sake of clarity and implicitly assume that any events or histories 
we talk about belong to E or H , respectively. An ETL frame can be viewed as a 
temporal tree (induced by the ~-> relation) with epistemic accessibilities between 
nodes. We will also consider an extension to forests, which are (finite) sets 
of trees with distinct roots and possibly interrelating epistemic accessibilities)^] 
Most of our considerations apply both to trees and to forests, and only in 



Section 5 we have to make the distinction explicit. We use properties of the 
epistemic accessibility relation to specify frames with a corresponding relation; 
for example, by an S5 frame we mean a frame with an S5 accessibility relation. 

The language of ETL consists of a finite set At of propositional atoms and 
of all formulas built from those according to the following grammar: 

p | ^(p | <p A ip | Kip | (e)ip, 

where p G At and ip, ip are formulas. Intuitively, Kip means that the agent knows 
<p, and (e)ip means that event e can occur and afterwards ip will hold. The 
remaining propositional connectives are defined as abbreviations as usual, and 
the duals of the modalities are denoted by L (dual of K) and [e] (dual of (e)). 
We write ()(p to abbreviate \f el£E (e)tp. 

A valuation V : At —> 2 H assigns to each atom the set of histories where it 
is true. We write T , V, h (= <p for a frame J 7 , a valuation V and a history h of 
the protocol of J- to say that p is satisfied by T , V, h. Satisfaction of formulas 
is defined inductively as usual, starting with the truth values of atoms as given 

2 The distinction between ETL frames and forests corresponds to the unique initial state 
condition in the interpreted systems literature. 
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by V, and with the following semantics: 



iff ft G V(p) 
iST,V,h\tip 

iff T, V, ft |= <p and J 7 , V, ft h ^ 

iff for each ft' G if with ft - ft': J 7 , V, ft' (= 9? 

iff he G if and J 7 , V, fte |= 99 



J", V, ft |= A ip 



J", V, ft h K( P 



A formula y> is said to be valid on J 7 , V if and only if J 7 , V,h\—ip for all ft G if . 
It is said to be valid on J 7 if and only if it is valid on J 7 , V for all valuations V. 
It is said to define a class C of frames if and only if it is valid exactly on the 
frames in C. 

For a binary relation R on histories we write [ft]# = {ft' | hRh'} to denote 
the image of ft under R. If if is a set of histories, we write [if].R for [J heH [h]B.- 
Obviously, if R is an equivalence relation, then [h]n is the equivalence class of ft 
with respect to R. 

3 Perfect recall 

In this section, we review existing definitions of perfect recall, give intuitive 
justifications for the notions, and examine how they relate to each other. 

Like in distributed systems, and unlike in game theory, in ETL there is no 
notion of turns and no notion of agency associated with events. An event is 
just an event and comes with no specification as to who performs it. In game 
theory, turn-taking typically makes successive situations distinguishable and 
perfect recall can often be formulated as "remembers all his actions" . In ETL, 
these features are not part of the modeJ^J and so we have to use other ways to 
express the notion. 

Whether or not time is part of the agent's perception is exactly what makes 
the difference between asynchronous and synchronous systems. Synchronicity 
can be defined separately, if it is desired; we are interested in perfect recall as an 
independent property, which does not interfere with (a)synchronicity, and thus 
should not assume or imply that agents perceive time. 

3.1 Basic definitions 

We start by giving some intuition about the notions we are going to define. 
As mentioned, an agent with perfect recall can at any point remember all the 
information that he had at any previous point in time, and is able to exclude 
any possibilities for the current state of the world which are inconsistent with 
that information. 

3 Put differently, events may perfectly well be caused externally and go completely unnoticed 
by any agent. If we do want to attribute certain events to certain agents (a view which 
certainly suggests itself in the single-agent case, and is also customary in game theory), then 
corresponding observability conditions for the agent performing a particular action can be 
specified separately, and our definitions of perfect recall will not interfere. 
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Two different intuitions for perfect recall There are two related ways 
in which an agent might detect such inconsistencies, the first on the level of 
epistemic states, and the second on the level of the semantic structures that 
model themj^] Consider a perfect- recall agent in some state of the world, in ETL 
terms a history, h, and some other history h' . 

Firstly, if in state h! the agent would have gone through a different sequence 
of epistemic states than he actually has in h, then he can exclude the possibility 
of h', since he can recall all his epistemic states. 

Secondly, if in the state before h the agent was certain that the world was 
not in a state along history h' , then at h the agent can exclude the possibility 
that the world is in state h' , since he can recall his previous assessments. Put 
differently, if hi is not an extension of some history considered possible before, 
then the agent can exclude the possibility of h' since there would have been no 
way for the world to evolve to h. 

We formalize these two intuitions in the following. As we will see, they are 
equivalent in the context of S5, while in the general case, neither implies the 



other (see Section 5 ) 



Formalizing the intuitions The first notion is the one most commonly used 
as starting point in the literature. It uses the idea of local-state sequences, or 
"epistemic experiences" , meaning sequences of epistemic states that the agent 
has gone through. Repetitions of identical states are ignored, since the agent 
has no way of discriminating between two states in which he has the same 
epistemic state. As in game theory (cf. [TO1 Section 11.1.3]), we identify an 
agent's epistemic state with his information set, i.e., the set of accessible worlds. 

Definition 3.1. Given an ETL frame and a history e± . . . eg, the agent's epis- 
temic experience is the sequence 

EE(ei ...eg) := [e]„ [e{\^ [eie 2 ]~ ... [ei . . . e e }^ 

of epistemic states (or information sets, in game theory parlance) he has gone 
through. 

We say that the epistemic experiences in two histories h, h' are equivalent 
modulo stutterings, in symbols EE(/i) « EE(/i'), if and only if the sequences 
with all repetitions of subsequent identical sets removed are equivalent. 

An ETL frame has perfect recall with respect to epistemic experience 
(PR ee ) if and only if, whenever h ~ h', we have EE(/i) s» EE(/i'). 

The second definition is a slight (but equivalent) variant of a notion most 
commonly used in the interpreted systems literature^] In the literature it has 
been mostly used as a technical condition characterizing PR ee , but by rephrasing 
it we can provide it with an independent motivation. 



4 See |Section 6| for some discussion related to the question of which aspects of the model an 
agent can access. 

5 See [7] p. 204] (who call perfect recall "no forgetting") and |19l Proposition 2.1(a)]. 
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Definition 3.2. An ETL frame has perfect recall with respect to history 
consistency (PRhc) if and only if for any histories h, h! and event e with he ~ h', 
there is some history h" with h ~ h" ~^>* hi (i.e., some prefix of h! is epistemically 
accessible from h). 

Put differently, the condition is that for each history h and event e, we have 

[he]„ C [[/i]^. . 

This second formulation suggests an intuitive reading: A frame has PRhc 
if all histories considered possible after some event are extensions of histories 
considered possible before the event. 



We refine this notion in Section 4 to obtain one that is more fine-grained and 
detects more inconsistencies in sub-S5 settings; however, in the context of S5 
the notions are equivalent, so for simplicity we stick with this definition for now. 

There are two further related conditions in the literature, which we will state 
next. 

Definition 3.3 (cf. [201 HI])- An ETL frame has synchronous perfect recall 
(sPR) if and only if for each h, h' , e with he ~ h! there is h" with h ~ h" h! . 
Put differently, the condition is that for each history h and event e, we have 

[heU C [[hUU ■ 

That is, all histories considered possible after some event are extensions of 
histories considered possible before the event by exactly one event. 

Definition 3.4 (cf. [HI p. 503, Definition 11]). An ETL frame has weak 
synchronous perfect recall (wsPR) if and only if for all h, h', e, e' with he ~ 
h'e', we have h ~ h! . Put differently, for each history h and event e we have 

[heU C [[hUU U W . 

It seems difficult to find an intuitive justification for this last definition: Why 
should an agent with perfect recall be characterized to consider possible, after 
some event, one-step extensions of histories previously considered possible or the 
empty history? In order to get a better understanding of the various notions, we 
now take a closer look at how they relate. 

3.2 Relating the notions 

First of all, as mentioned above, the two notions of PR ee and PRh c are equivalent 
in S5. 

Proposition 3.5. An S5 ETL frame has PR ee if and only if it has PRhc- 

Proof. This follows immediately from [191 Proposition 2.1], instantiating what 
the interpreted systems literature calls "local states" by the set of accessible 
worlds in ETL frames. 
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To give a version of the proof, we consider two histories and show that the 
conditions of PR ee and PRhc are equivalent. We first show that PR ee implies 
PRhc- For two empty histories this is obvious, so w.l.o.g. we assume that the 
first history is non-empty. So assume that PR ee holds and that fte ~ ft' . We 
have either of two cases: 

(i) [h]^ — [he]^. But then ft ~ ft', and PRh c is satisfied. 

(ii) [h]^ ^ [he]^. By PR ee , we must have EE(fte) « EE(ft'), and thus there 
must be ft" ft' with [h]^ — \h"]^. So again, PRhc is satisfied. 

To see that PRh c implies PR ee , we proceed by induction on the sum of the lengths 
of the two histories. The base case with both empty is straightforward. For 
the induction step, assume that PRhc holds. W.l.o.g. we assume that the first 
history is non-empty, so we consider fte and h! for some event e, with he ~ ft/. 
PRhc yields one of two cases: 

(i) h ~ h'. Then the induction hypothesis yields EE(h) s» EE(ft'). Further- 
more, we have [h]~ = [ft/]~ = [he]~, so EE(ft) ss EE(fte). Taken together, 
we obtain EE(he) EE(h'), and PR ee is satisfied. 

(ii) h ~ ft" for some ft" -< ft,'. It then follows that hi is non-empty. Let g be 
its direct predecessor, i.e., g ~* ft'. From ft' ~ fte, with PRhc it follows 
that there is ft'" ^ fte such that <? ~ hi" . If ft'" = fte, then PR ee follows 
analogously as in the previous case. Otherwise we have ft'" -< ft. The 
induction hypothesis yields EE(ft) sa EE(ft") as well as EE(g) ks EE(ft"'). 
Since ft" ^ g and ft'" ^ ft, we must have EE(ft) ps EE(g). Since ft ~^ fte and 
g ft', together with [fte]^ = [ft% we obtain that EE(fte) sa EE(ft'). □ 

As we see in the following, the remaining two notions, sPR and wsPR, are 
similar to these but impact another property, namely that of synchronicity. PR ee 
and PRhc, on the other hand, do not interfere with synchronicity. In agreement 
with the interpreted systems and game theory literature, we therefore use them 
as fundamental definitions of perfect recall in the context of S5, and due to their 
equivalence, we use perfect recall (PR) to refer to both. 

In the presence of synchronicity, not surprisingly, all notions are equivalent. 

Proposition 3.6. On synchronous S5 ETL frames, all of the above notions 
('PRee, PRhc, sPR, wsPRJ are equivalent. 



Proof. Straightfoward with [Proposition 3.5 see also [8j [20] . □ 



It is easy to see that sPR implies synchronicity, since is well-founded)^] 
Therefore, in general on S5 frames, sPR is equivalent to PR plus synchronicity. 
As for wsPR, the relationship is a bit less clear-cut. 



°One formulation of sPR is (cf. [Proposition 3.9| : "If the agent knows that at the next time 
point p holds, then at the next time point he knows that p holds." Intuitively this implies that 
the mere ticking of the clock affects the agent's mental state. 
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(a) PR, 
wsPR 



but not 



(b) wsPR, but not 
PR 



Figure 1: Two frames, gray lines indicating information sets, (a) wsPR is 
incomplete with respect to PR (wsPR is violated because eie^ ~ e2es but e\ ^ e 2 ), 
and |(b)| wsPR is not sound with respect to PR on ETL forests: Intuitively, event 
ei lets the agent "forget" that he is in the left tree. Note that on forests the 
definition of wsPR has to be adjusted by replacing {e} by the set of all roots. 



Proposition 3.7. On S5 ETL frames, wsPR implies PR, but not vice versa. 
Put differently, wsPR is sound but incomplete with respect to PR. 



Proof. Soundness is straightforward; for incompleteness, see Figure I 'a) □ 



In that sense, wsPR is "somewhere in between" sPR and PR: It is strictly 
implied^] by sPR and strictly implies PR. What distinguishes wsPR is that, while 
it (unlike sPR) does not imply synchronicity, it does (unlike PR) presuppose it, 
in that it fails to classify asynchronous frames correctly — given that, as we have 
argued, PR captures the intuition of perfect recall as an independent property. 
We therefore neglect wsPR in the further discussion: Synchronous perfect recall 
frames are naturally captured by sPR and asynchronous ones by PR, while wsPR 
has no clear domain of application in our context. 

Remark 3.8. Except where noted, all our considerations carry over to ETL 
forests (sets of ETL frames with possibly interrelating indistinguishabilities). 
The first such note is the fact that on forests, wsPR is not only incomplete with 
respect to PR but also not sound, as shown in Figure i fb") 



Note that the "local histories" of Parikh and Ramanujam [T3] give rise 
to frames in which exactly those histories are indistinguishable in which the 
epistemic experiences are equivalent modulo stutterings, so that their frames 
inherently satisfy PR|^] The version used by Pacuit et al. [12] analogously 
produces frames which inherently satisfy sPR (and thus synchronicity). 

Finally, we note that sPR is definable in ETL in a neat way, which also gives 
rise to an axiomatization. 



7 By this we mean "implies, but is not equivalent to" . 

8 In fact, the frames they obtain are exactly those S5 frames which satisfy PR and a "fixed 
observability" condition stating that, for each agent, there is a fixed set of events whose 
occurrence he is able to distinguish from the (non-)occurrence of others. 
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Proposition 3.9. An S5 ETL frame has sPR if and only if it validates the 
following formula: 

OLp -> L()p 

Together with S5, this axiomatizes ETL on synchronous S5 frames with perfect 
recall. 

This result is well-known and is analogous to [5D1 Theorem 4] and EJ Theo- 
rem 3.6], since sPR characterizes synchronous frames with perfect recallr] It can 
be proved using Sahlqvist [15] , similar to the proof of Theorem 4.4| 



A corresponding characterization of PR has been given by van der Meyden 
[T9"] . but that characterization uses the "until" operator. To our knowledge, a 
version using only "short-sighted" next-step temporal modalities has not been 
discussed. Providing it is the aim of the next section. 



4 Defining perfect recall in ETL 

We start by giving a "local" version of perfect recall with respect to history 
consistency, whose intuitive interpretation gives a more fine-grained account of 



the agent's possibilities for reasoning than PRh c does. As we will see in Section 5 
in general the notions are not equivalent, and the fine-grainedness of the version 
we propose indeed makes a difference. In the current section, however, we show 
that in the context of S5 this definition is equivalent to the preceding ones, 
and we exploit its locality to find an axiomatization of perfect recall using only 
next-step temporal modalities. 

Definition 4.1. An ETL frame has PRh C5 local version (PR^ C ) if and only if 
for each history h and event e, we have 

[he]„ C [h]„ U [[h]„]„ U [[he]„]„ 

Put differently, for each h, h', e with he ~ h' , either of the following holds: 

(i) h~h' 

(ii) h ~ h" ~> h! for some h" 

(iii) he ~ h" h' for some h" . 



See |Figure 2] for an illustration of this definition. Let us walk through it and 
compare it with PRh c - We consider the history he and refer to h as "before e" 
and to he as "after e" . The definition says that any history considered possible 
after e either 

(i) was considered possible already before e, i.e., the agent didn't notice e, nor 
time passing; or 



'Compare also the Cross Axiom of Dabrowski et al. [3]. 
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he h' 

I 

e 

h 

if he ~ ft', then 



fte ft' 

T 

e 

I 

ft 

(i) ft ~ ft', or 



fte 

T 



ft' 



fte^ ft' 

T 



ft ft" ft ft" 

(ii) ft ~ ft" ~» ft', or (iii) he ~ ft" — ft' 



Figure 2: Illustrating PR^. Gray, bent arrows indicate accessibilities, showing 
the directed versions for the sake of illustration. 




(a) PR hc (b) PR^ c 



Figure 3: PRf, c inductively bridges the gap to PRhc, but it imposes additional 
conditions on the intermediate states. However, in S5 the two conditions are 
equivalent. 



(ii) is an extension by one event of a history considered possible before e, i.e., 
the agent correctly thinks one event occurred, though he may not be certain 
which one; or 

(iii) is an extension by one event of another history considered possible after e. 



As illustrated in Figure 3 this last condition inductively bridges the gap to PRhc, 
and allows the agent to consider possible that several events occur while really 
just e is happening. The difference, as compared to PRhc, is that now there is 
a stricter consistency requirement. If the agent considers possible that several 
events have happened, he must obviously be unable to detect some of them, 
since really just one event happened. Given that, he must also consider possible 
the intermediate histories along these several events — either from the history 
after e or from before e. Exactly this consistency requirement is inductively 
captured by the last condition (in interplay with the second condition). 

Intuitively it is thus clear that PR(j c is at least as strong a condition as PRhc, 
as formalized in the next result. 

Lemma 4.2. Any ETL frame that has PR^,- also has PRhc- 

Proof. A simple induction on the length of h! in the definition of PRh c proves 
the claim. □ 
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Section 5 



we will see that PR^ C is in general strictly stronger than PRh c ; and 



in particular in Figure 4 that it detects situations where (intuitively) information 
is lost, for which PRh c fails to do so. However, in the context of S5, the notions 
are in fact equivalent. 

Proposition 4.3. An S5 ETL frame has PR if and only if it has PR(j c - 

Proof. Recall that we use PR to refer to PRh c and/or PR e e , since the y are 
equivalent according to Proposition 3.5 PR^c implies PRhc by 



Lemma 4.2 



Vice 

versa, a simple induction on the length of h' shows that PRhc and PR ee imply 

PRhc- □ 

Thus, in the context of S5, PR^c is equivalent to the "established" notions 
and we can use it to characterize perfect recall frames. 

Theorem 4.4. An ETL frame has PR^c */ an d on ^V if H validates the following 
formula for each event e (recall that ()(p abbreviates \/ e i(e')(f): 

(e)Lp ->■ LpM L()p V (e)LOp . (★) 

Together with the normal modal logic axioms and deduction rules, it is sound 
and complete with respect to the class of ETL frames with PRf^- 

Proof. This follows from the Correspondence and Completeness theorems by 
Sahlqvist [15] . In some more detail, note first that the formula as frame property 
is equivalent to 

Kp A KDp A [e]KDp -> [e]Kp , 

where dip abbreviates f\ e i[e'](p- This is a Sahlqvist formula, so as an axiom it is 
complete with respect to the class of frames it defines. To see what that class 
is, we start from the second-order formulation of this frame property (for any 
histories h, h! and event e' we write h ~^> e < h! if and only if he' = hf, and we 
write h hf if and only if h hf for some e'): 

VPWii[V7i 2 (/H ~ h 2 -> Ph 2 ) 

AWi 2 V/i3(/ii ~h 2 ^h 3 ^> Ph 3 ) 
A yh^h^ih^hi ~-> e h 2 ~ h 3 h± — > P/14)] 
— !> Vh 2 Vh 3 (hi ~> e h 2 ~ h 3 Ph 3 ) 

As |Sahlqvist| pointed out, since P does not occur negated in the consequent, 
the minimal instantiation of P satisfying the antecedent yields an equivalent 
first-order formula. This minimal instantiation can be read off as: 

Ph := hi ~ hV 3h 2 (hi ~ h 2 h) V 3h 2 3h 3 (hi ~-^ e h 2 ~ h 3 h) . 
Since it satisfies the antecedent, we are left with the instantiated consequent: 
VhiVh 2 yh 3 ~-> e h 2 ~ h 3 
hi ~ h 3 

V 3/14(^1 ~ /14 ~~> h 3 ) 

V 3/l43/l5(/li ~~> e hi ~ fl5 /I3)] . 
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Since there is at most one e-successor for any given history h (namely he), we 
can replace /14 in the last disjunct by It is then easy to see that this is 
equivalent to PR(j c . □ 

Corollary 4.5. An S5 ETL frame has PR if and only if it validates Q. 

Proof. Immediate with proposition 4.3| and |Theorem 4.4| □ 

We thus have an axiomatization of S5 ETL with perfect recall. However, 
some of the results we used indeed depended on S5. If we give up S5, we have 
to take a fresh look at certain issues, and that is the topic of the next section. 



5 Sub-S5 settings 

To our knowledge, perfect recall has only been considered in the context of S5 in 
the literature, a likely reason being that both communities that have studied 
the notion most (interpreted systems and game theory) virtually exclusively 
consider S5 settings. However, it may make perfect sense, for example, to say of 
a misinformed agent that he correctly remembers all information he has ever 
had, even if that information itself is not correct. In this section, we explore 
such settings of general ETL frames. 



5.1 Preliminaries 

We stick with the symmetric-looking symbol ~ even when the relation is not 
necessarily symmetric. Note that [h]^ now does not necessarily contain h itself 
anymore, but we have the following fact. 

Fact 5.1. If r~> is a transitive and Euclidean relation, then it is an equivalence 
relation on [h]~ for any h (cf. £3 Theorem 3.3]). Consequently, for any h,h' 
with [h]„ n [ti]~ ^ 0, we have [h]^ = [h'}^. 



Note that the motivation and justifications for the definitions of perfect recall 
we gave did not assume S5 knowledge. Each of the notions captured a particular 
way of not losing information, and they still make sense without S5. We therefore 
take over the basic definitions without any change, but take a new look at how 
they relate. 



5.2 Contrasting the notions 



First note that PRf, c still implies PRhc, since Lemma 4.2 did not assume S5 



However, without any assumptions about the frames, none of the oth er mutual 

and PR 



remain. This is witnessed by Figure 4 



implications among PRh c , PR^c 
illustrating that epistemic experience and history consistency reflect two different 
ways of remembering past information. 
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ei e 2 e 3 




i 



(a) PR ee , but not PR hc (b) PR hc and PR* c , but (c) PR hc and PR^ c , (d) PR hc , but not 
not PRee but not PR ee 



nor PRf 

he 



PR^ c nor PR e , 



Figure 4: PR hc , PR^ C , and PR e 



depicting the accessibilities. PRhc is violated in (a) 
is no prefix of e 2 e3 that is acce ssib le from e\ 
EE(ei) 76 EE(e 2 



and in 



(c) 



and 



compared on general ETL frames, gray arrows 
since e\e^ ~ e 2 e 3 but there 
PR ee is violated in |(b)| since 
is violated 



(d) since EE(ei) 56 EE(e 2 e 3 ). PR* 



in (d) since e± ~ e 2 e3 but e 9^ e 2 e3 and e 7^ e 2 and ei 7^ e 2 . 



(a)| An agent that only has perfect recall with respect to epistemic experience 
may at some point be certain that a particular history can be excluded, 
but later on "forget" this piece of information. In particular, at eie 3 the 
agent considers e 2 e3 possible, even though he never considered e 2 possible. 



[(b)] and [( 



An agent that only has perfect recall with respect to history consistency 
may at some state consider another state possible, although in that other 
state his epistemic experience would have been different. For example, an 



agent at ei in (c) is (mistakenly) certain that he is at e 2 e 3 , even though 
in that state his previous information set would have been {e 2 }, which 
contradicts his actual epistemic experience. 



(d) The intuition is similar to the previous case, but here we see that PR 



he 

is more fine-grained than PRh c - An agent at e\ thinks he is at e 2 e3, even 
though he never considered e 2 possible. He thus thinks himself at the 
endpoint of a history whose unfolding he deemed impossible. PRhc grants 
this agent the label of perfect recall, while PRh c denies it. 

Note that, while these phenomena reflect some kind "forgetting" , they do 
not at first glance constitute a coherent, rational method of belief revision. A 
full-fledged doxastic logic is needed in order to really model agents that reconsider 
their previous assessments and deal with "unwanted" memories properly. 

The following straightforward result enables us to identify the settings in 
which the different notions of perfect recall can be meaningfully compared. 



Proposition 5.2. Any ETL frame that has PR ee is transitive and Euclidean. 
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Proof. This is obvious from Definition 3.1 For example, for any three histories 



h,h',h", if h ~ hi and h ~ h" , then PR ee implies that [h]^ = [h% = [h'%. 
Since h',h" G [/i]^, we also get hi £ [h'% and h" e □ 

This result is not very surprising, given that PR ee requires of an agent to be 
able to assess his own epistemic experience — including at the current state. It 
implies that any reflexive ETL frame with PR ee is already an S5 ETL frame. 
On the level of agents, an agent who has correct beliefs and PR ee has in fact 
already full (S5) knowledge. However, perfect recall does not require the agent to 
have correct beliefs (in fact, perfect recall by itself is compatible with believing 
falsum). For example, KD45 is a common sub-S5 setting in which perfect recall 
is a meaningful notion. 

Given that transitivity and Euclideanness are inherent to PR ee , we continue 
our comparison within the corresponding class of frames. In the following, we 
use introspective to mean "transitive and Euclidean" . 

5.3 Characterizing PR ee locally 

Given the fact that PRh c no longer characterizes PR ee and the original definition 
of PR ee is somewhat unwieldy, it can be useful to have a local condition on 
histories and accessibilities that corresponds to it. It turns out that we can 
re-use PR^ C by slightly modifying the frame in question. 

For a frame T with accessibility relation ~, we will use T and ~ to denote 
the S5 closure. We need the following small technical condition: We say that 
a frame satisfies persistent insanity if, whenever [h]^ = and h < h! , then 
[h 1 ]^ = 0. Intuitively, once a corresponding agent has inconsistent beliefs, he 
will remain in that pitiful condition forever. 

Proposition 5.3. An introspective ETL frame satisfying persistent insanity has 
PR ee if and only if its S5 closure has PR^ e p^| 



Proof. Due to Proposition 4.3 PR ee and PRf, c are equivalent on the S5 closure. 
We can thus prove the claim by showing that PR ee is invariant under taking this 
closure. 

To see that this is indeed the case, take any pair h, h' of histories, the 
accessibility relation ~ of an introspective frame satisfying persistent insanity, 



and its S5 closure ~. With Fact 5.l[ it is easy to see that, as long as [h]~ ^ 



we have [h]^ = [hf]^ if and only if [h]^ = [hf]^. Inductively it follows that the 
equivalence of epistemic experiences is invariant under taking the S5 closure as 
long as [h]~ 7^ 0; persistent insanity ensures that PR ee is also satisfied for any h! 
extending an h with [h]„ = 0- □ 

To see that persistent insanity is indeed needed for this result, consider 
Figure 4p) with the accessibilities e2 ~ e\ and e\ ~ e\ removed. The resulting 



frame still has PR ee , but its S5 closure does not have PR£ 



10 Note that this is indeed a local condition: On introspective frames the S5 closure is the 
symmetric and reflexive closure, without any need of iterating through the accessibility relation 
(cf. |Fact 5.1) . 



14 



Corollary 5.4. A KD45 ETL frame has PR ee if o,nd only if its S5 closure has 
PR; 



he- 



Proof. Immediate, since KD45 frames are introspective and vacuously satisfy 
persistent insanity. □ 



Remark 5.5. Note that PR(, C implies persistent insanity so Proposition 5.3 applies 
to all introspective frames with PR^c- 



As witnessed by Figure 4 and by Figure 5 later on, the notions PR ee and 



PRh c are incomparable in the sense that each one is stronger than the other one 
under certain circumstances, proposition 5. 3| gives an insight as to why this is so: 
By applying the PR^ condition to the S5 closure of a frame, on the one hand the 
antecedent in this condition becomes more permissive, but on the other hand so 
does the consequent. Thus, the condition gets both strengthened and weakened. 



Now that we have contrasted our basic notions of perfect recall and provided 
and discussed separate local characterizations, we proceed to characterize the 
combination of the notions. We use PR to denote the combination of perfect recall 
notions, PR ee plus PRh c (and thus PRhc), describing perfect-recall agents that 
can reason both about their epistemic experience and about history consistency. 

As mentioned earlier, our considerations so far hold both for ETL trees and 
ETL forests. Now, however, the distinction becomes important. We start by 
focusing on trees. 



5.4 Characterizing PR on trees 

It turns out that on introspective trees, PR^ captures both definitions of perfect 
recall, much like it (and PRhc) did on S5 frames. This allows us to define and 



axiomatizc PR on introspective trees, reusing the results we obtained in Section 4 



Theorem 5.6. An introspective ETL tree has PR if and only if it has PR^c- 



Note that this result is not in contradiction with the examples in Figure 4 



since |(b) | is not transitive and (c) is not Euclidean. For the proof, we need the 
following auxiliary results. 

Observation 5.7. For any introspective ETL frame with PR^ and histories 
hi,h,2 with hi ^ hi and hi ~ hi, for each h[ ^ hi there is h' 2 d hi such that 
h[~ h ' 2 . 

Proof. The claim can be shown with a simple induction on h%, using [Lemma 4.2] 
and transitivity of X. □ 

Lemma 5.8. For any introspective ETL frame with PR^ C and histories hi and 
h' 2 ^h <hi, if hi ~ hi and hi ~ h' 2 then hi~h. 
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Proof. With Euclideanness, we obtain ft 2 ~ h' 2 . Let ftr; be the shortest prefix 



of ft 2 such that ft 2 ~ ft 2 (note that ft 2 ' d ft'2 d ft)- Observation 5.7 implies that 
there must be b! < h'2 with ft ~ ft/. Another application of Observation 5.7 
then yields that there is h" ;< h' such that ft 2 ~ ft", and by transitivity we get 
ft 2 ~ h" . Now if ft' -< h'2 then ft" -< ft 2 , contradicting that ft 2 is the shortest 
prefix accessible from ft 2 . So h' = h'2, thus h ~ ft 2 '. Since ftx ~ ft 2 ~ ft 2 , we 
obtain the claim. □ 



Lemma 5.9. If an introspective ETL tree has PR^ C , then so does its S5 closure. 

Proof. Take any introspective tree J- with PR^ C . To see that its S5 closure P 
also has PRh c , let h, e, ft' be such that fte~ h' . We need to show that ~ satisfies 
one of the three conditions in the definition of PRf,,.- 

Since ~ is the symmetric and reflexive closure of ~ (cf. footnote 10), we have 
either of these cases: 

• he = ft'. Since ft~ ft, condition ([ij]) in the definition of PR^ C obtains. 



• he ~ ft'. Since T has PR 
thus so does ~. 



he 



satisfies one of the three conditions of PR 



he 



• h' ~ he. If ft' 7^ e then the same argument as in the previous case applies. 
Otherwise, ft' = e ~ he. Euclideanness of ~ yields he ~ he, and since ~ 
satisfies PRh c , we have either of these three cases: 



(i) h ~ he. Since h! 
PR* 



he, we get ft~ft', so ~ satisfies condition (Ml) of 



x hc- 



(ii) h ~ h. Since ft' = e ^ ft, Observation 5.7 yields that there is h" ■< h 
such that h' ~ ft". Now we have ft' ~ fte, ft.' ~ h" and h" < h < he, 
Lemma 5.8 applies and yields ft' ~ft. Symmetry of ~ yields ft~ft/, 



so 



so ~ satisfies condition (jij) of PR^ C . 

(iii) he ~ ft. Together with ft' ~ fte we get ft' ~ ft. Symmetry of ~ again 
yields ft - ft', condition (|) of PR^ C . □ 

We can now straightforwardly prove the stated result. 



Proof o/ | Theorem 5. 6] PR implies PRh c by definition. To see that the reverse 
direction h olds, take any introspective ETL t ree T that has PR^L. Due to 

and 



Lemma 5.9 



its S5 closure also has PRf, c , and with Proposition 5.3 



it follows that J- also has PR„ 



Remark 5.5 



□ 



Since the proof of |Theorem 4.4| did not use S5, we immediately obtain an 
axiomatization of ETL on introspective trees with perfect recall. Further, it is 
easy to see that on synchronous trees, sPR and PRh c are still equivalent, so we 
also have an axiomatization of ETL on synchronous introspective trees with 
perfect recall. 
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(a) Forest T (two trees) 



(b) Forest T 1 (three trees) 



Figure 5: (a) J 7 is an introspective forest that has PRh c , but not PR ee . (b) T' has 



PR£ C and PR ee , 



and J- is its bounded morphic image via the bounded morphism 
depicted with dashed arrows. So PR is not modally definable on forests. 



5.5 Characterizing PR on forests 



Theorem 5.6 does not apply to forests, as witnessed by Figure ffia) Before we 



look at how to characterize PR here, we note that, unlike on S5 forests, defining 
PR on introspective forests generally is impossible in ETL (the same holds for 

PRee). 

Proposition 5.10. PR is not modally definable on introspective ETL forests 
(and thus not on general ETL forests either). 



Proof. T' in Figure 5 has PR, while its bounded morphic image J- does not. 
Since modally definable properties are closed under bounded morphic images 
(cf. pQ), the claim follows. □ 

From proposition 5.3| and |Rcmark 5.5| it is clear that any introspective frame 
has PR if and only if both it and its S5 closure have PRh c - However, with an 
additional slight restriction, we can continue to use PR^c to characterize PR. 
From Figure 5] it is intuitively clear that accessibilities from some root to a later 



state in some (different) tree are problematic: In such cases, PRf, c is vacuously 
satisfied, while PR ee may not hold. 

To fix this, call an ETL forest T initially synchronous if, for any two 
roots e, e' and history h with e <h and e' ~ h, we also have e' ~ e. That is, 
the agent at least considers it possible that indeed no time has passed initially, 
although he may immediately lose synchronicity and also consider later states 
possible. We then get the following. 

Lemma 5.11. If an introspective and initially synchronous ETL forest has PR^ C , 
then so does its S5 closure. 

Proof. The proof is analogous to that of |Lcmma 5.9| with one additional ob- 
servation: If e' ~ h for some history h with root e, then initial synchronicity 



yields e' ~ e. Euclideanness then yields e ~ h, and with Theorem 5.6 it fol- 



lows that EE(e) EE(h). Due to Fact 5.1 we also have EE(e') EE(e), so 



EE(e') w EE(h) by transitivity of «. □ 
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Theorem 5.12. An introspective and initially synchronous ETL forest has PR 
if and only if it has PR^ C - 

Proof. Analogously to Theorem 5.6| this follows from |Lemma 5.11| |Proposi^| 
Ition 5.31 and IRcmark 5.B1 □ 



6 Conclusions 

We discussed two different ways of "not losing information" , that is, accessing 
and reasoning with one's memories. The first one has been the fundamental 
definition in the literature on perfect recall. It assumes that a perfect-recall 
agent can use differences in past epistemic states in order to distinguish present 
states. The second one is a consistency condition on the histories considered 
possible. While it has been used in the literature as technical condition, we 
provided it with its own motivation. 

The two notions have previously been studied in S5, where they coincide, and 
in logics with long-range temporal operators. We gave a novel characterization 
and axiomatization in ETL, using only next-step temporal operators. 

We then dropped the assumption of S5 and noticed that the notions no longer 
coincide. Since they capture two independently motivated ways of reasoning 
with memories, we examined and characterized them individually as well as 
jointly. 

Given that the two notions use different aspects of ETL models, some 
discussion is needed concerning the access that we assume an agent to have. 

It is a general issue in modeling agents to what extent the model faithfully 
represents an agent's internal workings, and to what extent it represents the 
modeler's external perspective. What we mean if we say that an agent "does 
not lose information" , of course, depends on what information we ascribe to him 
in the first place. ETL is agnostic as to whether the agent has direct access 
to the semantic structures constituting a model or whether they are just a 
representation for the modeler, and whether the logic language is supposed to 
reflect the agent's "mentalese" or whether it is just a way for the modeler to talk 
about the agent. Depending on the intended interpretation, one may exclude or 
include certain features in what is considered the agent's information, and one 
may accept or reject certain methods for the agent to access and reason with his 
memories. 

Since ETL does not specify these issues, we simply examined what can be 
said if the agent has access to certain aspects of the model. Outside of S5, where 
the notions do not coincide, it depends on the modeled situation which definition 
of perfect recall is the right one. 

An interesting question for further research is whether there are additional 
aspects of reasoning with memories, which might be conflated in S5 with the 
ones we discussed, but distinct in other settings. 

The general goal with these considerations is to help improve our under- 
standing of the assumptions implicit in the framework or explicitly made by the 
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modeler when modeling agents. Along the lines of the inspiring work by van 
Benthem et al. |18j . we hope to obtain more fine-grained insights in more general 
settings. 
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